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[0001] The present invention claims the benefit of Japanese Patent Application No. 2000- 
390837 filed in Japan on December 22, 2000, which is hereby incorporated by reference. 

BACKGROUND OF THE INVENTION 

10002] The present invention relates to an image encoding device, and more particularly to an 
image encoding device which encodes image data, an image encoding program and a recording 
medium for the same. The present invention also relates lo an image decoding device which 
decodes a compressed image file, an image decoding program, and a recording medium for the 
same, and an electronic camera which is equipped with an image encoding device. 

PJ Discussion of the Related Art 

[0003] Encoding algorithms and encoding processing is known in the art. For example the 
{JJ JPBG200() encoding algorithm and encoding processing is an encoding procedure that includes; 
ry Color Coordinate Transformation, Wavelet Transformation, Quantization, Bit Modeling, ROI 
Q. (&e&<>n of Interest) function, and Arithmetical Encoding of the Bit Stream Formation to form a 

compressed image file. 

i 

: 

[0004] In the Color Coordinate Transformation the input image is subjected to a color 
coordinate transformation as required. 

[0005] In the Wavelet Transformation the image is subjected to discrete wavelet 
transformation in the vertical and horizontal directions, and is divided into a plurality of sub- 
bands (LL, LH, HL, HH). Among these, the LL band of the lowest frequency region is 
repeatedly subjected to decomposing wavelet transformation in a recursive manner. 
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[0006] In tfte Quantization the wavelet transformation coefficients are quantified by each sub- 
band. Furthermore, in unifying processing, the Quantization step is always set at "1 " Here, in 
the case of compression, the lower N bit planed are discarded in an after-process. This 
discarding processing is equivalent to a Quantization step u 2 to the power of N." 

[0007] In thje Bit Modeling, following Quantization, the wavelet transformation coefficients 
ate divided into encoding blocks of a fixed size (e.g., 64 x 64) within each sub-band. After the 
transformation coefficients within each encoding block are divided into sign bits and absolute 
values, the absolute values are distributed among a natural binary number of bit planes. The bit 
* planes thus constructed are encoded in order from the upper bit plane via three types of encoding 
I passes (significance pass, refinement pass and cleanup pass). Furthermore, the sigti bits are 
| encoded imnie4iately after the uppermost bits of the corresponding absolute values have 
y appeared on the bit plane. 

3 

% {0008J In a E[OI (Region of Interest) encoding function, a greater quantity of information is 
STJ preferentially allocated to a selected region on the image, so that the decoded image quality of 
III the selected region is improved. In concrete terms, the transformation coefficients (following 
q Quantization) that are positioned in the selected region are shifted upward by S bits, and are then 
subjected to the above-mentioned bit modeling. As a result, the selected region is shifted to the 
upper bit planesl and is encoded wit& a higher priority than any bit of the non-selected region. 

[0009] Furthermore, in the max shift method, the bit shift number S is set so that it is large*- 
than the place member of the uppermost bit in the non-selected region. Accordingly, the non- 
zero transformation coefficients of the selected region always have a value of "2 to the S power 7 '' 
or greater. Consequently, during decoding, the transformation coefficients of the selected region 
can easily be reproduced by selectively shifting quantified values of "2 to the S powet" or 
greater dovmwaijd- 
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{001 0] In the Arithmetical Encoding of the Bit Stream Formation the SNR progressive and 
space resolution progressive, etc., are realized by arranging the data of the respective encoding 
blocks according to combinations of four axes (importance of bit plane, space resolution, block 
position and color components). 

[001 1] For example, in the case of SNR progressive, the respective encoding blocks are split 
for each encoding pass, and the split data is classified according to degree of contribution to the 
improvement of SNR, so that a plurality of layers are constructed. An SNR progressive bit 
stream is formed by linihg these layers up in order from the top. Fixed-length compression can 
be realized by cutting this bit stream using an, appropriate file ske, 

[0012] Furthermore, more detailed and accurate international standards can be ascertained via 
ISO, ITU-T and other standards organizations, 

[001 3] In the JPEG2Q00, a division into a selected region and a non-selected region is 
ordinarily performed using a mask image of a binary bit map. As the numbers of vertical and 
horizontal pixels of the image increase, the quantity of data in this mask image increases. As a 
result, the following problem arises: in the ROI processing system, the mask image with a 
variable quantity of data must be handled by buffering, so the implementation of the ROI 
processing system becomes complicated. 

[0014] Furthermore, each time that the numbers of vertical and horizontal pixels of the image 
are varied, a maisk image must be newly prepared, which results in a heavy processing burden. 

[0015] Moreover, since the mask image has a large quantity of data, the burden of transferring 
the mask image to the ROI processing system and the burden of storing the mask image as data 
also are heavy. 



10016) Furthermore, in the wavelet transformation, the numbers of vertical and horizontal 
samples of the transformation coefficients vary according to the sub-band split region. 
Accordingly, the mask image must be enlarged or reduced in accordance with each sub-band 
split region, so that the burden of calculating the resolution conversion also is heavy, 

SUMMARY OF THE INVENTION 

[0017] Accordingly, the present invention is directed to an image encoding device, electronic 
camera and recording medium that substantially obviates one or more of the problems due to 
limitations anil disad vantages of the related art. 



I1J 



[0018J An dbject of the present invention is to accomplish the division into the selected region 

and non-selected region that is performed at the time of image encoding with a smaller 

111 

ijj processing burden. 

f [0019) Another object of the present invention i3 to determine the selected region with 
f|j appropriate matching to the image at the time of image encoding. 

g [0020] Furthermore, another object of the present invention is to accomplish the division into 
yk s$ ] ec ted region and non-selected region that is performed at the time of image decoding with 
a smaller processing burden. 

[0021] Additional features and advantages of the invention will be set forth in the description 
which follows, and in part will be apparent from the description, or may be learned by practice of 
the invention. The objectives and other advantages of the invention will be realized and attained 
by the structure particularly pointed out in the written description and claims hereof as well as 
the appended drawings. 

(0022] To achieve this and other advantages and in accordance with the purpose of the present 

invention, as embodied and broadly described the image encoding device, electronic camera aiid 

i 

recording medium is equipped with a transformation component which transforms given image 
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data into transformation coefficients by subjecting Ibis image data to a frequency decomposition, 
a dividing component which divides the transformation coefficients produced by the 
transformation component into a "selected region on the image" and a "non-selected region other 
than the selected region," and an encoding component which encodes the transformation 
coefficients % preferentially allocating a greater quantity of information to the selected region 
than to the non-selected region, and the dividing component performs an equation evaluation of 
numerical equation data that stipulates the boundary of the selected region, and determines 
whether the transformation coefficients belong to the selected region on the basis of the results of 
this equation Evaluation. 

Q [0023] In another aspect of the invention in the image encoding device the dividing component 
jj is equipped with a numerical equation preparation component which performs an edge detection 
for the image data, determines an outline On the basis of the results of this edge detection, and 

-S3 

*0 prepares numerical equation data that approximately expresses the outline, and an equation 

%. \ 

u, evaluation component which perfoims an equation evaluation of the above-mentioned numerical 

f|j 

pj equation data prepared by the above-mentioned numerical equation preparation component, and 
tj which makes a judgement on the basis of the equation evaluation results as to whether the 
jl transformation .coefficients belong to the selected region. 

[0024] In anctther aspect of the invention in the image encoding device the dividing component 
is equipped with a numerical equation preparation component which performs a color boundary 
detection for the image data, determines an outline on the basis of the results of this color 
boundary detection, and prepares numerical equation data that approximately expresses the 
outline, and an equation evaluation component which performs an equation evaluation of the 
above-mentioned numerical equation data prepared by the above-mentioned numerical equation 
preparation component, and which makes a judgement on the basis of the equation evaluation 
results as to whether the transformation coefficients belong to the selected region. 
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[0025] In another aspect of the invention in the image encoding device the dividing component 
is equipped with a numerical equation preparation component which performs a space frequency 
component detection for the image data, determines an outline on the basis of the results of this 
space frequency component detection, and prepares numerical equation data that approximately 
expresses the outline, and an, equation evaluation component which performs an equation 
evaluation of !the above-mentioned numerical equation data prepared by the above-mentioned 
numerical equation preparation component, and which makes a judgement on the basis of the 
equation evaluation results as to whether the transformation coefficients belong to the selected 
^ region. i 

53 [0026] In anlother aspect of the invention in the image encoding device the encoding 

111 

jg component forms a compressed image file from the combined encoded transformation 

t 

yi coefficients and the numerical equation data used by the dividing component. 

« [0027] In another aspect of the invention, an image decoding device decodes the compressed 
pj image file compressed by the image encoding device, This image decoding device being 
\* equipped with a decoding component which reads, out the encoded transformation coefficients 
O from the compiiessed image file and decodes these transformation coefficients, re-dividing 
component which reads out the numericalequation data from the compressed image file, 
performs an equation evaluation, and makes a judgement on the basis of the results of this 
equation evaluation as to whether (he transforation coefficients decoded by the decoding 
component belopg to the selected region, an adjustment component which adjusts the form of 
expression of the transformation coefficients in the selected region and the form of expression Of 
the transformation coefficients in the non-selected region in accordance with the division of the 
re-dividing component, and a reverse transformation component which performs a reverse 
transformation on the image data using the transformation coefficients whose forms of 
expression have been adjusted by the adjustment component as sub-band components. 
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(0028] in another aspect of the invention an electronic camera is equipped -with an image 
encoding device, and an imaging component which produces image data by imaging an object of 
imaging and which sends the image data thus produced to the image encoding device. This 
imaging encoding device comprises a transformation component which transforms given image 
data into transformation coefficients by subjecting this data to a frequency decomposition, a 
dividing component which divides the transformation coefficients produced by the 
transformation component into a selected region on the image and a non-selected region other 
than the selected region, qad an encoding component which encodes the transformation 
coefficients by preferentially allocating a greater quantity of information to the selected region 
than to the iloij-selected region. The dividing component performs an equation ©valuation of 
l Z numerical equation data that stipulates the boundary of the selected region, and determines 

111 whether the transformation coefficients belong to the selected region on the basis of the results of 

SJ 

J the equation evaluation. 

[0029] In another aspect of the invention an image encoding program which is used to cause a 
RJ computer to filiation as the transformation component, dividing component and encoding 
h component described above, is recorded on a recording medium, 

[0030] In andther aspect of the invention an image decoding program which is used to cause a 
computer to function as the decoding component, re-dividing component, adjustment component 
and reverse transforation component described above, is recorded on a recording medium. 

[0031] In a ffrst embodiment of the present invention, numerical equation data that stipulates 
the boundaries of the selected region is subjected to an equation evaluation, and a judgement is 
made as to whether the transformation coefficients belong to the selected region- As a result 
several advantages are obtained. The quantity of the numerical equation data does not vary even 
if the numbers of vertical and horizontal pixels of the image increase. Accordingly, in the ROI 
processing system, it is necessary only to handle numerical equation data in which the quantity 
of data is substantially fixed, so that the implementation of the ROI processing system can be 
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simplified compared to conventional examples in which a mask image in which the quantity of 
data varies is; handled by buffering. Numerical equation data can also be quickly applied to 
images in which the numbers of vertical and horizontal pixels differ by perforating a simple 
coordinate transformation- Accordingly, since the trouble of preparing a tnask image, etc; each 
time that the numbers of vertical and horizontal pixels of the image change is eliminated, the 
processing burden is correspoiidingly reduced compared to conventional examples. The quantity 
of numerical equation data is generally smaller than the quantity of data in a mask image. 
Accordingly, the burden of data holding in the ROI processing system can be reduced compared 
u to conventional examples in which a mask image is handled. Furthermore, the burden 6f 

y transmitting data to the ROI processing system can also be reduced. 

fi i 

[0032] Furfhennore, as a result of the present invention numerical equation data can be applied 

III ' * . 

to a plurality of sub-band split regions by performing a simple coordinate transformation. 

** Accordingly, in the present invention, the trouble of converting the resolution of the mask image 

in accordance with the number of samples, which occurs in conventional examples, does not 

||j arise. In the present invention, as a result of a synergistic effect of these-advantages, the 

{J processing burden of the division into the selected region and non-selected region that is 

yk performed during encoding of the image can be appropriately reduced. 

[00331 In a second embodiment of the present invention, numerical equation data is prepared 
on the basis of edge detection of the image. Accordingly, a main object of imaging with sharp 
edges can be foirnd in an image, arid a selected region can be appropriately set along the edges of 
this main object, of imaging. 

[0034] In a third embodiment of the present invention, numerical equation data is prepared on 
the basis of detection of the color boundaries of an image- Accordingly, a main object of 
imaging with sharp color boundaries can be found in an image, and a selected region can be 
appropriately set along the color boundaries of this main object of imaging, 
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[D035] In i fourth embodiment of the present invention, numerical equation data is prepared on 
the basis of die detection of the space frequency components of an image. Accordingly, a main 
object of imaging with specific space frequency components can be found in an image, and a 
selected regidn can be appropriately set along the main object of imaging. 

[0036] In ajfifth embodiment of the present invention of the image encoding device the 
numerical equation data used by the dividing component is contained in the compressed image 
file. The quantity of this numerical equation data is generally smaller than the quantity of data in 
a mask image. Accordingly, the capacity of the compressed image file can be reduced compared 
p to a case in which a mask image is contained in the compressed image file. 

O : 

PJ [0037] Meanwhile, in the image decoding device of another embodiment, the division into the 

■£ 

flj selected region and non-selected region is performed using numerical equation data in the file, 

"I! In this case, the determination of the selected region can be accurately performed under the same 

» conditions as ip the image encoding device. 

l|i 10038] The electronic camera of the present invention is equipped with the image encoding 

N device described in any of the previous embodiments. Accordingly, the processing time required 

O 

yk for division into the selected region and non-selected region during encoding of the image can be 
appropriately reduced. As a result, the image processing time inside the electronic camera can 
be shortened compared to that required in conventional examples, so that an electronic camera 
that is easier to use can be realized. 

[0039] The image encoding device of any of the described embodiments can be realized by 
using a computer to execute an image encoding program or an image decoding program. 

[0040] It is to foe understood that both the foregoing general description and the following 
detailed description are exemplary and explanatory and are intended to provide further 
explanations of the invention as claimed 

BRIEF DESCRIPTION OF THE DRAWINGS 



[0041] The accompanying drawings, which are included to provide a further understanding of 
the invention and are incorporated in and constitute apart of this specification, illustrate 
embodiments of the invention and together with the description serve to explain the principles of 
the invention^ In the drawings: 



[0042] Figure 1 is a block diagram which illustrates the construction of the electronic camera 1 
and image encoding device 11; 



hk [0043] Figure 2 is a block diagram of the image decoding device 21; 



Kj [0044] Figure 3 is a flow chart (1/2) which illustrates the operation of the image encoding 
| device 11; 



# [0045] Figure 4 is a continuation of the flow chart of Figure 3 which illustrates the operation of 

y, the image encoding device 1 1 ; 

m 

; [0046] Figure 5 is a diagram which shows the conditions of the coordinate transformation in 
O respective sub-band split regions; 

[0047] Figures 6A-6D are diagrams which illustrates the procedure of the smoothing 
processing; 

[0048] Figure' 7 is a continuation of the diagrams of Figures 6A-6D which illustrates the 
procedure of the smoothing processing; and 

[0049] Figures 8-1 through 8-9 are diagrams which illustrate the division of the boundary line 
into sections; 

[0050] Figures 9A-9B are diagrams which illustrate the division of the boundary line into 
Sections; and 
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[0051) Figure 10 is a flow ohart which illustrates the operation of the image decoding device 
21. 



DETAILED DESCRIPTION OF THE INVENTION 

[0052] Reference will now be made in detail to the pt eferred embodiments of the present 
^ invention, examples of which are illustrated in the accompanying drawings. 

© 

P 10053] Figure 1 is a block diagram which illustrates the construction of the electronic camera 1 

111 | 

JS and image encoding device 1 L In Figure 1, an imaging lens 2 is mounted in the electronic 

111 

camera 1 . The light-receiving plane of an imaging element 3 is disposed in the image space of 
^ this imaging tens 2- The image data produced by the imaging element 3 is subjected to A/D 

\& conversion an4 color interpolation processing, etc., via an image processing circuit 4, and is then 

Hi ; 

^ sent to the image encoding device 1 1 . The compressed image file output from this image 
H» encoding devide 1 1 is sent to a recording part 5. The recording part 5 records this compressed 

-u image file on aimemoiy card 6. 

i 

[0054] Next, the internal construction of the above-mentioned image encoding device 1 1 will 
be described. The image data input into the image encoding device 11 is converted into a 
compressed image file via a color transformation part 12, a wavelet transformation part 13, a 
quantifying part 1 4, a bit modeling part 1 5, an arithmetical encoding part 1 6 and a bit stream 
production part 17. 

[0055] Fuitheimore, a numerical equation preparation part 1 8, an equation evaluation part 1 9 
and a numerical -equation accommodating part 20 are installed in the image encoding device 1 L 
Image data, wavelet transformation coefficients and the focus area, etc> are input into this 
numerical equation preparation part 18. The equation evaluation pari 19 acquires numerical 
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equation data from the numerical equation preparation part J 8 or numerical equation 
accommodating part 20, and performs an equation evaluation of this numerical equation data. 
The bit modeling part 15 performs bit shift processing of the selected region on the basis of the 
equation evaluation results of the equation evaluation part 19. Furthermore, in cases where a 
method oflierithan the max shift method is used, the equation evaluation part 19 sends the 
numerical equation data used to designate the selected region to a bat stream production part 17. 

[0056] Figiire 2 is a block diagram of the image decoding device %\ used to decode the 
compressed image file prepared by the above-mentioned image snco'ding device 1 L In Figure 2 3 
the compressed image file that is input into the image decoding device 21 is converted into 
decoded image data via an arithmetical decoding part 22, a bit modeling decoding part 23 3 
reverse quantifying part 24, and a reverse wavelet transformation part 26 5 in that order. 
m 

(0057] Ftlrtherrnora, an equation evaluation part 27 is installed in the image decoding device 

* 21 . fn cases where numerical equation data is present in the compressed image file, this equation 

evaluation part 27 acquires this numerical equation data and performs an equation evaluation- 
Hi 

fu The bit modeling decoding part 23 performs extraction and shift-down processing of the selected 



Q 
O 



C region in accordance with the results of this equation evaluation. 



W-i 



[0058] Transformation component are provided including the color transformation part 1 2 and 
wavelet transformation part 13, the dividing component including the equation evaluation part 
19, numerical equation preparation part 18 and function of dividing the transformation 
coefficients into* a selected region and non-selected region on the basis of numerical equation 
data of the bit modeling part 15, the encoding component including the bit modeling part 15, 
arithmetical encoding part 16, and bit stream production part 17, 

[0059] Numerical component could also include numerical equation preparation component 
including the numerical equation preparation part 18 and .tile equation evaluation component of 
the equation evaluation part 19* 

l-WA/1713860.4 13 
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(0060] Decoding component could also be provided including the arithmetical decoding part 
22 and bit modeling decoding part 23, the re-dividing component including the equation 
evaluation part 27 and the 'function of dividing the decoded transformation coefficients into a 
selected region and non-selected region on the basis of numerical equation data" of the bit 

modeling decoding part 23, the adjustment component corresponds to the "function of shifting 

i 

down the seldcted region and matching this with the bit expression of the non-selected region" of 
the bit modeling decoding part 23, and the reverse transformation component including the 
reverse wavelet transformation part 26. 

E 10061] The image encoding device includes the image encoding device 1 1 , the imaging 

B component of the imaging element 3, and image processing circuit 4, 

i y 

fj [0062] Figures 3 and 4 are flow charts which illustrate the operation of the image encoding 
2 device 11. Thjb operation is described according to the step numbets shown In Figure 3. 

H [0063] Step SI : The color transformation part 12 performs a color coordinate transformation 

111 

III on the given image data as required, and converts this data into color components such as 
U YCbCr. 

[0064] Step S2; The wavelet transforation part 13 performs a sub-band decomposition by 
wavelet transformation on the image data output from the color transformation part 12, and thus 
converts the image data into transformation coefficients for each sub-band split region. 

[0065] Step S3: The quantifying part 14 quantifies the transformation coefficients as required. 

[0066] Step S4: The equation evaluation part 1 9 refers to user setting items stored in the 
internal memory (not shown in the figures) of the electronic camera 1 ? and discriminates the 
mode setting of HOI encoding. Here, in cases where the numerical equation preparation mode is 
selected, the equation evaluation part 19 shifts the operation to step S21 shown in Figure 4. Qn 
the other hand, in cases where the numerical equation selection mode is selected, the equation ' 
evaluation part 19 shifts the operation to step S5. 
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[0067} Step S5: The equation evaluation part 19 refers to the user setting items of the 
electronic camera 1, and reads out numerical equation data corresppnding to the shape of the 
selected region designated by the user from the numerical equation accommodating part 20. 

[0068] Step S6: The equation evaluation part 19 performs an equation evaluation of the 

1 i 
numerical equation data in line units of the sub-band images, and transmits the right end and left 

end of the selected region to the bit modeling part 15 in line units. 

[0069] Typical numerical equation data will be concretely described below. 

(A) In the Case of a Circle with a Center of (a, b) and a Radius of t 
Line y present in the selected region; b-r£y£b4-r 



jy Left and Xleftia line y; Xleft = a- V^-fy-b) 2 ) 

RighiendXrightinliney; Xright = a + V(/-(y-b) 2 ) 

(B) In the Case of a Rectangle with an Upper Left Vertex (xl , y 1) and a Lower Right 
LJt Vertex (x2 7 y2) 

O Line y present in the selected region; yl <, y £ y2 

Left end Xleft in line y: Xleft = xl 
Right ^nd Xright in line y: Xright~x2 

(C) In the case of an Ellipse with a Center of (a, b)> a Radius of rl in the Row 
Direction, and a Radius of i2 in the Column Direction 

Line y present in the selected region: b~r2£y£b + r2 



Left end Xleft in line y: Xleft- a-rl x V (1 ~(y-~bf/t2 2 ) 



Right end Xright in line y: Xright = a + rl x V(l -(y~b) 2 /r2 2 ) 
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[0070] Step S7: After dividing the transformation coefficients into sign bits and absolute 
values, the bit modeling part 15 distributes the absolute values to a natural binary number of bit 
planes. Here, the bit modeling part 15 acquires the left end and right end of the selected region 
from the equation evaluation part 19 in line units, 

[0071] The" bit modeling part 1 5 subjects this left end and right end to a coordinate 
transformation (reduction or enlargement) in accordance with the number of vertical and 
horizontal samples in each sub-band split region. Figure 5 shows the conditions of the 
coordinate transformation for three points (xa, ya) s (xb, yb) and (xc, yc) m each sub-band split 
region. 

[0072] The bit modeling part 1 5 extracts transformation coefficients from the left end to the 
'% right end in line units in each sub-band split region, and shifts these transformation coefficients 
*. Upward by thelshift bit number of the ROI encoding, 

ill [0073] StepSS: The bit modeling part 15 performs entropy encoding pfthe bit planes thus 

Is. 1 

2 constructed via three types of encoding passes (significance pass, refinement pass and cleanup 
yk pass) in order from the upper bit plane. Furthermore, the sign bits axe encoded immediately after 
the uppermost bits of the corresponding absolute values appear in the bit plane. 

[0074] Step 59: The arithmetical encoding part 16 inputs the data for which the above- 
mentioned entropy encoding has been completed, and performs arithmetical encoding. 

[0075] Step SJ0: The bit stream production part 17 rearranges the arithmetically encoded data 
according to four axes (importance of the bit plane, space resolution, block unit and color 
component), and realizes SNR progressive or space resolution progressive, etc. 

[Q076] For example, in the case of SNR progressive, the bit stream production part 17 
constructs a plurality of layers by classifying the data in the order of the contribution of the data 
to the improvement of the SNR The bit stream production part 17 foims an SNR progressive bit 
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stream by rearranging these layers in order from the top. The bit stream production part 17 
completes a compressed image file (compressed by fixecHeagth compression) by catting this bit 
stream using] an appropriate file size. 

s 

[0077] Stdp SI 1 : The bit stream production part 17 makes a judgement as to whether max 
shift type ROjl encoding has been performed. Here, in the case of a max shift system, the bit 
stream production part 17 shifts the operation to step S12. On the other hand, in the case of a 
system other than the max shift system, the bit stream production part 1 7 shifts the operation to 
step S13, i 

g 10078] Siep Sl2; Since the encoding in this case is max shift type ROI encoding* the 
fW numerical equation data describing the selected region is not needed for decoding, Accordingly, 
jy the bit stream production part 17 accommodates only the shift bit number S in the header 1 
y| information of the compressed image file. 

Hj [0079] Step $13: Since the encoding in this case is ROI encoding other tban max shift type 
fij ROI encoding, the rmmerical equation data describing the selected region is needed for decoding. 

Accordingly* the bit stream production part 17 acquires numerical equation data from the 
1* equation evaluation part 19 as character sequence data, and accommodates this numerical 

equation data in the header information of the compressed image file together with the shift bit 

number S. 

[0060] A compressed image file is completed as a result of the above-mentioned series of 
operations. Next, the operation that is performed in cases where the numerical equation 
preparation mode is selected will be described in accordance with the step numbers shown in 
Figure 4. i 

{0081] Step S21; The numerical equation preparation part 1 8 refers to the user setting items of 
the electronic camera 1 3 and discriminates the numerical equation preparation mode setting, 
Here, in cases where the edge detection mode has been set, the numerical equation preparation 
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part 18 si^ifts the operation to step S22. Furthermore, in cases where the color boundary 
detection mdde has been set, the numerical equation preparation part 18 shifts the operation to 
step S23. On the other hand, in cases where the space frequency detection mode has been set, 

the numerical equation preparation part 18 shifts the operation to step S24. 

I 

[0082] Step S22-, The numerical equation preparation part 1 8 perfdrtns a local filter processing 
such as that of a Laplace operator on the image data, and produces a, processed image from 
which the edge parts are extracted. Following the production of such a processed image, the 
numerical equation preparation part 18 shifts the operation to step S25. 

10083] Step S23: The numerical equation preparation part IS compares the color components 
Bl of the image 6pt% and extracts the color boundaries, thus producing a processed image consisting 

rif of color boundaries. Following the production of such a processed image, the numerical 

H 



equation preparation part 1 8 shifts the operation to step S25. 



j* [00S4] Step S24: The numerical equation preparation part 1 8 covers gaps by performing line- 
fy. thickening processing on the high sub-band split regions in pixel units, thus reducing the region 

of concentrated high-band components to several regions. The numerical equation preparation 
h* part 18 performs a local filter processing such as that of a Laplace operator on this image 3 thus 

producing a processed image consisting of edge parts of regions of concentrated high-band 

components, Following the production of such a processed image, the numerical equation 

preparation pari 18 shifts the operation to step S25, 

[4)085J Step S25: After converting the processed image produced in one of steps S22 through 
S24 into absolute values 7 the numerical equation preparation part 1 8 binaries the image using an 
appropriate threshold value that takes noise resistance into consideration, thus producing a 
binarized imaged 

{0086] Step S26: The numerical equation preparation part 18 performs line-thinning 
processing on the binarized image, thus producing a boundary line thickness of "1 " 
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[0087] Step S27: The numerical equation preparation part 1 8 performs smoothing processing 
on the binarized image. The concrete processing procedure of this smoothing processing will be 

described be|ow with reference to Figures 6 and 7. 

i 

[Q088J In Figure 6A the numerical equation preparation part 18 detects the connections of 
points with ailine Width of 1 from the binarized image, and expresses the results in the memory 
using a chain code with eight directions (vertical, horizontal and diagonal). Furthermore, the 
numerical equation preparation part 1 8 searches for code that is continuous in one direction 
among the chain code, collects this continuous code and replaces the continuous code with a 
N single vector code. The vectorization of the binarized image is completed as a result of such 

q processing. ■ 

fU 

j| i [0089] In Figure 6B the numerical equation preparation part 1 8 determines the sum of the 
N| vector lengths of the continuous vector code. Here, in cases where the sum of the vector lengths 

is less than a specified value (e,g, 3 100), the continuous vector code is deleted. Short vector 
K I codes are eliminated by this processing. 

Mj [0090J In Figure 6C the numerical equation preparation part 1 8 searches among the continuous 
5 vector code for locations where vectors with a length of 1 dot intersect, and synthesizes 

intersecting vectors. As a result of this processing, 1-dot indentations and projections in the lines 

are eliminated. 

[0091] In Figure 6D the numerical equation preparation part 1 8 searches among the continuous 
vector code for locations where the vector direction is reversed. In cases Where the duplicated 
lengths of these Reversed vectors are less than a specified value (e.g„ 10), the numerical equation 
preparation part 18 synthesizes reversed vectors. Unnecessary whisker-form lines are eliminated 
by this processing. 

[0092] In Figure 7 the numerical equation preparation part 1 8 searches among the continuous 
vector code for vectors that are shifted parallel to each other by an interval of 1 dot (V3 in Figure 
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7). The length of this vector V3 and the lengths of the parallel vectors (VI and V5 in Figure 7) 
are compared, and in a case where the length of the vector V3 is shorter, the vectors VI and V5 
are directly connected, and the intermediate vectors (V2, V3 and V4 in Figure 7) are eliminated. 
As a result of this processing, ^rectilinear portions that are shifted hi parallel by an interval of 1 
dot can he shaped. 

[0093] Furthermore, the smoothing processing of the binarized image can be performed even 
more strongly by repeating the above-mentioned processing a multiple number of times. 

u [0094] Stepi S28 (Figure 4); The numerical equation preparation part 1 8 acquires positional 

O information concerning the focus area used during imaging of the image data from the side of the 

Q.I 

llj electronic camera 1 . The numerical equation preparation part 18 searches among the vector 

Jh codes for vector codes centered on this focus area and directed toward the periphery. Following 

N| up the found vector codes in order, the numerical equation preparation part 1 8 searches for 

3 vector code groups that form closed regions. In the search for these closed regions, vector codes 

^ that approach each other Within a specified interval are treated as connected vector codes. 

f 

H 8 ' [0095] Furthermore, in cases inhere the vector codes that are followed up cross the image 
frame above oil below or to the left or right* the image frame is considered to be a part of the 
vector code. ' 

i 

[0096] Step S29: The numerical equation preparation part 1 8 connects cuts for vector code 
groups that can form closed regions. 

(0097] Step S30; The numerical equation preparation part 18 divides the boundary lines of the 
connected closed regions into sections on the left end side or right end side. Figure 8 shows the 
section division rule for the boundaries of such closed regions. This section division rule will be 
described below with reference to Figure 8. 

[0098] As shoton in Figure 8-1, in cases where there is no boundary line in the top line, and the 
point XI has appeared for the first time, this line is taken as the beginning line of a new selected 
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Tegion. Accordingly, the numerical equation preparation part 18 takes this location XI as 'the 
starting point for the respective boundary lines on the left end side and right end side. 

[0099J As shown in Figure 8-2 7 in cases where there is no hounddry line in the top line 3 and the 
left end X2 apd right end X3 have appeared for the first time, this line is taken as the beginning 
line of anewiselected region* Accordingly, the numerical equation preparation part 18 takes X2 
as the starting point of the boundary line on the left end side, and X3 as the starling point of the 
boundary line on the right end side, 

[00100] As figure 8-3 illustrates, b cases where there is no boundary line in the bottom line, 
O and this line ends at point X4, this line is taken as the final line of the selected region. 
% Accordingly, the numerical equation preparation part 1 8 takes this location XI as the end points 
§1 of the respective boundary lines on the left end side and right end side, 

i 

yg [00101] Figmje 8-4 shows cases where there is no boundary in the bottom line. This line ends at 

the left end XS and right end X6, this line is takefc as the final line of the selected region. 
W Accordingly, tlae numerical equation preparation part 1 8 takes X5 as the end point of the 
U boundary line on the left end side, and X6 as the end point of the boundary line on the right end 




100102] Figure 8-5 illustrates cases where the boundary line on the left end side is shifted 
discontinvtously to the left from the relay point XI 0 to the relay point X9 3 this is a point of 
discontinuity; consequently, it is desirable to divide the boundary line into sections. 
Accordingly, the numerical equation preparation part 1 8 takes the left pad X7 one line above as 
the end point of (the boundary line on the left end side, and the right end X8 on the same line as 
the left end X7 as the end point of the boundary line on the right end side. Furthermore, the 
numerical equation preparation part 18 takes the left end X9 as the starting point of a new 
boundary line on the left end side, and the right end XI 1 on the same line as the left end X9 as 

the starting point of a new boundary line on the right end side- 

i 
i 
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[00103] Figure 8-6 shows cases where the boundary line on the left end side is shifted 
discontinuously to the right from the relay point X12 to the relay point X13, this is a point of 
discontinuity;; consequently, it is desirable to divide the boundary line into sections. 
Accordingly, the numerical equation preparation part 18 takes the left end X12 as the end point 
of the boundary line on the left end side, and the right end X14 on the same line as the left sad 
X12 as the eiid point of the boundary line on the right end side. Furthermore, the numerical 
equation preparation part 1 8 takes the left end X15 one line below as the starting point of a new 
boundary line on the left end side, and the right end XI 6 on the same line as the left end XI 5 as 
the starting pbint of a new boundary line on the right end side, 

o \ 

Q [00104] Figure 8-7 illustrates cases where the boundary line on the right end side is shifted 

fit , 

% discontinuous^ to the right from the relay point X20 to the relay point X21 , this is a point of 

W discontinuity; » consequently, it is desirable to divide the boundary lirie into sections. 

%g Accordingly, tjie numerical, equation preparation part 1 8 takes (he right end XI 8 one line above 

as the end point of the boundary line on the right end side, and the left end XI 7 on the same line 
W as the right end XI 8 as the end point of the boundary line on the left end side. Furthermore, the 
j»* numerical equation preparation part 18 lakes the right end X21 as the starting point of a new 
j*f boundary line on the right end side, and the left end X19 on the same line as the right end X21 as 

the starting point of a new boundary line on the left end side. 

[00105] Figure 8-8 shows cases where the boundary line on the right end Side is shifted 
discontinuous!^ to the left from the relay point X24 to the relay point X23 3 this is a point of 
discontinuity; consequently, it is desirable to divide the boundary line into sections. 
Accordingly, the numerical equation preparation part 18 takes the right end X24 as the end point 
of the boundary 'line on the right end side, and the left end X22 on the same line as the right end 
X24 as the end point of the boundary line on the left end side. Furthermore, the numerical 
equation preparation part 18 takes the right end X26 one line below as the starting point of a new 
boundary line cx\ the right end side, and the left end X25 on the same line as the right end X26 as 
the starting point of a new boundary line on the right end side. 
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[00106] Figure 8-9 demonstrates cases where the boundary lines on the left end and right end 
are connected with the line above as in the case of the relay points ?C27 and X28 3 the numerical 
equation preparation part 18 does not divide the boundary line into sections. 



[00107] Figute 9A is a diagram which shows one example of a boundary line divided into 
sections according to the above-mentioned rule. In cases where the closed region has indented 
parts as shoWjn in Figure 9A, three or more boundary lines are present within the same line. 
Accordingly, the numerical equation pteparationpart 18 Successively judges pairs of these 
boundary lineis from the left (or right) side, and adds section points (Q6, R6 5 Q3 and R3 shown in 
M= Figure 9B) for the lines in .which new pairs are generated. 

Si [00108] St?p>S31 (Figure 4): The numerical equation preparation part 1 8 approximates the 

*P boundary line divided into sections as described above using a function such as a broken line 

RJ 

function, a Bezier function, a spline function or a multi-order functioti, and completes numerical 
*7 equation data ip which the left end side and right end side are paired. Furthermore, in this 
J* functional approximation, it is desirable that the boundary line be further divided into sections so 
that the precision of the approximation does not drop. 



~j [00109J Following the completion of such numerical equation data, the numerical equation 
preparation part 18 returns the operation to the above-mentioned step S6. As a result, ROI 
encoding is performed on the basis of numerical equation data newly prepared in accordance 
with the image data. 

[00110] Fig^e ,10 is a flow chart which illustrates the operation of the image decoding device 
21 in the present working configuration. The operation of the image decoding device 21 will be 
described according to the step numbers shown in Figure 10. 

[00111] Step S41: The arithmetical decoding part 22 performs arithmetical decoding of the 

given encoded d^ta. 

i 
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[00112] Step S42: The bit modeling decoding part 23 performs entropy decoding (with the bit 
planes as units) on the encoded data that has been arithmetically decoded, and thus determines 
the decoded transformation coefficients, 

[00113] Step S43: The bit modeling decoding part 23 makes a judgement as to whether 
numerical equation data is present in the compressed image file. Here, in cases where numerical 
equation data is not present, the bit modeling decoding part 23 shifts the operation to step S44. 
On the oth^r hand, in cases where numerical equation data is present, the bit modeling decoding 
part 23 shifts the operation to step 1 S45, 

{001141 Sterpi S44; Since numerical .equation datais not preserit, the bit modeling decoding part 
23 judges that the encoding is ROI encoding based on the max shift method, and acquires the 
shift bit mimbftr S from the compressed image file. In the case of coefficients of planes higher 
than this shift bit number S, the bit modeling decoding part 23 judges that these coefficients are 
in the selectedj region of ROI encoding, and shifts the coefficients downward by the shift bit 
number S. Affcr the bit expression of the selected region aiid non-selected region has been 
adjusted by such processing, the bit modeling decoding part 23 shifts the operation to step S4S, 

t 

[001 15J Step S45: The equation evaluation part 27 reads out the numerical equation data from 
the compressed image file. 

[00116] Step S46: The equation evaluation part 27 performs an equation evaluation on the 
numerical equation data, and transmits the left end and right end of the selected region to the bit 
modeling decoding part 23 in line units. 

[00117] Step S47; The bit modeling decoding part 23 extracts the selected region on the basis 
of the above-mentioned left end and right end, and shifts the bit planes (decoded transformation 
coefficients) of &e selected region downward by the shift bit number 5, 

[00118] Step S48: The reverse quantifying part 24 performs reverse quantifying processing by 
multiplying the quantifying step size used during encoding by the decoded transformation 
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coefficients.. Furthermore, in cases where the quantifying step size used during encoding is "1," 

the reverse tjuantifying part 24 omits this reverse quantifying processing. 

i 

[00119] Step S49i The reverse wavelet transformation part 26 acquires the decoded 
transformation coefficients processed by the reverse quantifying part 24, The reverse wavelet 
transformation part 26 subjects these decoded transformation coefficients to a reverse wavelet 
transformation (sub-band synthesis), thus converting the coefficients into decoded image data. 
Decoded image data is completed as a result of the above-mentioned series of operations. 

[00120J la the described present working configurations, the selected region is divided into 
sections using numerical equation data. The quantity of such numerical equation data does not 
vary even if the numbers of vertical and horizontal pixels of the databeing handled increase. 
Accordingly* in the equation evaluation part 19, it is necessary only to handle equation data in 
which the quantity of data is substantially fixed, so that, the implementation of an ROI processing 
sydtem can be simplified compared to conventional examples in which a mask image in which 
the quantity of! data varies is handled by buffering. 

|00121] Furthermore, the quantity of data in such numerical equation data is extremely small 
compared to that in a mask image. Accordingly, the burden of data holding in the ROI 
processing system can be reduced compared to conventional examples in which a mask image is 
handled. Moreover, the burden of transmitting numerical equation data from the numerical 
equation accommodating part 20 to the equation evaluation part 19 can also be reduced. 

(00122) Furthermore, the numerical equation data can be quickly applied to a plurality of sub- 
band split regions by performing a simple coordinate transformation. 

[00123] MoreoVer, in the present working configuration, a main object of imaging with sharp 
edges can be found in an image, and a selected region can be appropriately set along the edges of 
this main object ff imaging, 
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[00124] Furthermore, in the present working configuration, a main object of imaging with sharp 
color boundaries can be found in an image, and a selected region can be appropriately set along 
the color boundaries of this main object of imaging. 

i 

(00125] Moreover, in the present working configuration, a region with a specific space 

frequency distribution can be found, and a selected region can be aripropriately set along the 

i 

boundary line of this region. 

[00126] Furthermore, in the present working configuration, the numerical equation data used 
y* during encoding is contained in the compressed image file. The quantity of this numerical 
p equation data is generally smaller than the quantity of data in a mask image. Accordingly, 
W compared to cases in which a mask image is contained in a compressed image file, the file 
ry capacity can be reduced to a considerable extent- Furthermore, by using the numerical equation 
Jl data in the compressed image file during decoding, it is possible to perform the division into the 
? selected region and non-selected region accurately under the same conditions as those existing 
fij during encoding. 

ru • 

J00127] Furthermore, in the above-mentioned working configurations, the judgement of the 
selected region is accomplished using equations that express the boundary lines on the left and 
right end. Accordingly, this method is advantageous in that the left end and right end of the 
selected region can be quickly determined in line units. However, the present invention is not 
limited to this. iFor example, it would also be possible to use inequality data that stipulates the 
boundaries of the selected region* In this case, the question of Whether the transformation 

coefficients of pixel positions belong to the selected region can be detennined by substituting the 

i 

pixel positions into the inequality data, and performing an equation evaluation in order to 
determine whether inequality is established. 

[00128] Furthermore, in the above-mentioned working configurations, a case Was described in 
which the image encoding device 1 1 and image decoding device 21 were constructed in blocks 
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by means of a plurality of processing parts. However, the present invention is not limited to this 
construction. 



(00129] Foi) example, it would also be possible to prepare an image encoding program and 

i 

image decoding program that are used to cause a computer to perform the operations of the 
respective processing parts described above (e.g., the flow charts shown in Figures 3, 4 S and 10), 



[00130] Furthermore, the working of the present invention regarding programs and recording 
media for such programs is not limited to the above-mentioned working configurations. For 
\* example, it would also be possible to distribute the programs via a communications circuit, and 
j5j. to record the programs in the system memories or hard disks, etc., of destination computers. By 
W means of such program distribution, the program distribution source can manufacture programs 

fU and recording media for such programs in destination locations. Furthermore, by means of such 

m 

program distribution, the distribution source can transfer the'programs and recording media for 
such programs to the destinations. Moreover, the fact that the programs can be distributed can be 

fU announced via i sn£h a communications circuit, and a service that provides information regarding 

RJ 

the location where the programs ate stored can be offered. 

[00131] It will be apparent to those skilled in the art that various modifications and variations 
can be made in the image encoding device, image decoding device, electronic camera and 
recording medium of the present invention without departing from the spirit or Scope of the 
invention. Thus, it is intended that the present invention cover the modifications and variations 
of this invention provided they come within the scope of the appended claims and their 
equivalents- 
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